Inter-similarity between coupled networks 
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Recent studies have shown that a system composed from several randomly interdependent net- 
works is extremely vulnerable to random failure. However, real interdependent networks are usually 
not randomly interdependent, rather a pair of dependent nodes are coupled according to some regu- 
larity which we coin inter-similarity. For example, we study a system composed from an interdepen- 
dent world wide port network and a world wide airport network and show that well connected ports 
tend to couple with well connected airports. We introduce two quantities for measuring the level 
of inter-similarity between networks (i) Inter degree-degree correlation (IDDC) (ii) Inter-clustering 
coefficient (ICC). We then show both by simulation models and by analyzing the port-airport sys- 
tem that as the networks become more inter-similar the system becomes significantly more robust 
to random failure. 



Recently, an American Congressional Committee high- 
lighted the intensified risk in an attack on national infras- 
tructures, due to the growing interdependencies between 
different infrastructures However, despite the high 
significance and relevance of the subject, only a few stud- 
ies on interdependent networks exist and these usually 
focus on the analyses of specific real network data [2|46| . 
The limited progress is mainly due to the absence of theo- 
retical tools for analyzing interdependent systems. Very 
recent studies @, H| present for the first time a frame- 
work for studying interdependency between networks and 
show that such interdependencies significantly increases 
the vulnerability of the networks to random attack. In 
these studies, the dependencies between the networks are 
assumed to be completely random, i.e., a randomly se- 
lected node from network A is connected and depends 
on a randomly selected node from network B and vice 
versa. Due to the dependencies an initial failure of even 
a small fraction of nodes from one network can lead to an 
iterative process of failures that can completely fragment 
both networks. 

However, the restriction of random interdependencies 
is a strong assumption that usually does not occur in 
many real interdependent systems. As a first example 
consider the two infrastructures that are mentioned both 
in the committee report [l| and in the studies discussed 
above [1,0,13]: The Italian power grid and SCADA com- 
munication networks. A power node depends on a com- 
munication node for control while a communication node 
depends on a power node for electricity. It is highly un- 
likely that a central (high degree) communication node 
will depend on a small (low degree) power node. Rather, 
it is much more common that a central communication 
node depends on a central power station. Moreover, cou- 
pled networks usually also poses some similarity in struc- 
ture, for instance, an area that is overpopulated is bound 
to have many power stations as well as many communica- 
tion nodes. Another real example is the world wide port 
and airport networks that we study in this manuscript. 



We find that well connected ports tend to couple to well 
connected airports therefore supporting our assumption 
that real interdependent networks are usually not ran- 
domly interdependent. 

In this Letter we show that inter-similar coupled net- 
works, i.e. coupled networks in which pairs are coupled 
according to some regularity rather than randomly, are 
significantly more robust to random failure. Moreover, 
increasing the inter-similarity between the networks leads 
to a fundamental change in the networks behavior. While 
randomly interdependent networks disintegrate in a form 
of a first order phase transition 0, HJ , networks with high 
levels of inter-similarity disintegrate in a form of a sec- 
ond order phase transition. The phase transition occurs 
in the size of the largest connected cluster, F^, of one 
of the networks (or both) when a critical fraction q c of 
nodes fail (or a critical fraction p c = 1 — q c remains) . For 
randomly interdependent networks, when only a fraction 
p c of nodes remains abruptly drops to zero charac- 
terizing a first order phase transition. For high levels of 
inter-similarity we find that continuously decreases 
at criticality, characterizing a second order transition. 
Fig. [1] presents simulation results showing the change in 
the type of phase transition for increasing levels of inter- 
similarity. 

We develop two measures to asses the level of inter- 
similarity between interdependent networks. We show 
that these measures can also determine the robustness of 
coupled networks. The first quantity, r AB , measures the 
inter degree-degree correlation (IDDC) between a pair of 
dependent nodes. The two networks A and B have a 
degree distribution of p£ and p B respectively. Similar 
to assortative mixing in a single network we define 
by ejk the joint probability that a dependency link is 
connected to an A-node with degree j and to a -B-node 
with degree k. For networks with no IDDC, ejk — pfPk- 
For networks with IDDC, the level of correlation can be 
defined by ^2j k jk(ejk —pfp k ). Normalizing by the max- 
imum value of IDDC we obtain a general measure, 
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in the range — 1 < r < 1. The value 1 is achieved for 
a system with maximum IDDC, the value of zero for no 
IDDC and a value -1 for a system with maximum anti 
IDDC. If the two networks have the same degree distribu- 
tion (pk = Vk = Pk) the maximum IDDC value is given 
by u \ = J2k k2 Pk ~ (J2k k Pk) 2 and we obtain 
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Positive values of r AB indicate that high degree nodes 
from network A tend to couple with high degree nodes 
from network B and vise versa. Negative values of r AB 
indicate that high degree nodes from network A tend 
to couple with low degree nodes from network B and 
vise versa. Randomly interdependent networks corre- 
spond to the case of r AB = 0. The second measure is 
the inter-clustering coefficient (ICC), c AB , that evalu- 
ates for a pairs of dependent nodes { Aj , Bj } how many 
of the neighbors of Aj depend on neighbors of Bj and 
vice versa. Analogous to a single network [lcj , we define 
the local inter clustering coefficient, cf of node Aj as 



(2) 



where tj is the number of links connecting the neighbors 
of Aj to the neighbors of Bj and kf is the degree of Aj 



Note that cf is not equal to cf . The global ICC 



can be defined as the average of all the local clustering 
coefficient, c A = Ylj cf. But in this case c A i= c B . We 
therefore prefer to define the global clustering as 



1 X ^ 
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where M is the total number of dependency links be- 
tween the two networks and < c AB < 1. For increasing 
more of the neighbors of Aj depend on 



values of 
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the neighbors of Bi and the two networks become more 
inter-similar. For c AB — 1 the two networks must be 
identical. 

The effect of inter-similarity between networks is dra- 
matically influenced by the network topology. In a case 
where two interdependent networks have a broad degree 
distribution, an interdependent pair {Aj , Bj } can greatly 
differ in their degree. As a result the diversity in the 
correlation between the networks (IDDC) is significantly 
increased. We therefore apply our theory to two impor- 
tant and very different network topolo gies . The first is 
the Erdos - Renyi (ER) network model [12Hl4j , in which 
all links exist with equal probability leading to a Pois- 
son degree distribution P(k) = e - {k) (k) k /k\. The ER 
network model has become a classic model in random 
graph theory and was intensively studied in the past few 
decades. The other model is that of scale free networks 
(SF) [TBI, [l6| networks with a broad degree distribution, 



usually in the form of a power-law, P(k) ~ k 7 with 
7 > 2. It was found that many real networks are scale- 
free [H, [Hi. 
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FIG. 1: (a) Simulation results for P^, the fraction of nodes 
remaining in the largest cluster of network B after a random 
failure of a fraction 1 — p of the nodes in network A. The sim- 
ulations compare four different configurations (see text) of 
two interdependent SF networks with A = 2.7 showing that 
inter-similar coupled networks are significantly more robust 
to random failure compared to randomly interdependent net- 
works (the value of p for which Poo approaches zero is much 
smaller), (b) Simulation results showing the number of it- 
erations (NOI) in the iterative process of cascading failures, 
at p c . The NOI is plotted as a function of the similarity 
(S) between the networks which is measured either by the 
IDDC (circles), or by the ICC (squares). As the networks 
become more inter-similar the NOI is reduced indicating that 
less nodes fail. When measuring the effect of the IDDC on 
the NOI the ICC is kept zero. Similar, when the effect of ICC 
is measured the IDDC is kept zero. The dashed line marks 
the region that cannot be properly simulated since the ICC 
is too high to generate networks with no IDDC. 



To show the effect of our measures on the robustness of 
inter-dependent networks, we compare between the fol- 
lowing four systems: (i) Two randomly interdependent 
SF networks {r AB = and c AB = 0). (ii) Two SF net- 
works where every pair of dependent nodes {Aj,Bj} has 
the same degree , kf = k B (r AB = 1 and c AB = 0). 
(iii) Two interdependent SF networks with r AB = and 
c AB = 0.4, which is the maximum ICC we were able 
to obtain without inserting IDDC. (iv) Two identical 
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interdependent SF networks (r AB — 1 and 
FigfJJa) presents Poo, the fraction of nodes remaining in 
the largest cluster of network B after a random failure 
of a fraction 1 — p of network's A nodes. The Figure 
shows that high IDDC even with no ICC or high ICC 
even with no IDDC, significantly increases the fraction 
of failing nodes (smaller p c ) that will fragment the sys- 
tem (Pqo = 0), indicating that the system is more robust. 
Moreover, for high IDDC or ICC the jump in the size 
of Pqo that characterizes a first order phase transition 
changes to a gradual decrease identified with a second 
order transition. FigrTfb) provides additional support 
for our claim that inter-similarity increases the robust- 
ness of inter-dependent networks. The number of iter- 
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ations (NOI) in the process of cascading failures at p c 
for a network of size N, scales with N 1 / 4 for randomly 
interdependent networks pj and is equal to 1 for iden- 
tical networks. The figure shows that indeed when the 
inter-similarity is increased either via the IDDC measure 
or via the ICC measure, the NOI decreases respectively. 

Next, we study a real interdependent system composed 
from the world wide port network and the world wide 
airport network. The airport network is composed from 
1767 airports and records the majority of the air traffic 
around the world. The port network is composed from 
1076 ports and records the flow of commodities around 
the world. Previous studies have shown 17-2(| that 
different transportation systems that are located in the 
same city (or area) depend on each other through their 
common influence on the economic prosperity of that city. 
In terms of our two networks, the evolvemcnt of an air- 
port in a city will lead to an increase in air-traffic that 
in tern will result in economic prosperity. The prosper- 
ity of that city will have a positive effect on the evolve- 
ment and increase of traffic to that city's port and vise 
versa. Accordingly, for our mapping we assume that a 
port depends on a nearby airport and vise versa. How- 
ever, since the networks are not of the same size we first 
renormalized the networks so that they corresponds to 
the model presented in 0, [![. We first match between 
pairs of ports and airports with the minimal distance 
between them under the condition that a port only de- 
pends on one airport and vise versa. The remaining air- 
ports that do not depend on any port are merged with 
the closest airport such that the new renormalized node 
includes the accumulated traffic of these airports. A sim- 
ilar process is applied to the port network. At the end 
of this process we obtain two networks both of size 992 
that are coupled based on geographical location (GL). 
We find that for the GL interdependent port-airport net- 
works the coupling between the networks is not random, 



the IDDC parameter is 
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for randomly interdependent networks) indicating that 
high degree ports tend to couple with high degree air- 
ports. These findings supporting our theory regarding 
inter-similarity between real interdependent networks. 

The next step is to enquire how the high level of IDDC 
in the port-airport networks effects the robustness of the 
system. Fig f2] presents of the port network for an in- 
creasing fraction of failing nodes in the airport network 
(similar results are obtained when the initial nodes fail 
from the port network). The figure compares between 
two configurations of the port-airport system: (i) The 
networks are randomly coupled, (ii) The networks are 
coupled based on geographical location (GL). The re- 
sults support our theory that a systems with high IDDC 
is more robust to random attack (P^ is larger) and that 
the phase transition changes from first to second order 
as the networks become more inter-similar. However, 
since each of the networks has a very high average de- 



gree (within each network the nodes are well connected) 
and as a result the networks are very hard to fragment, 
we have made the reasonable assumption that even if 
75 percent of the traffic to a certain port (or airport) is 
disabled that port becomes non functional. 




FIG. 2: The sea-air interdependent system is composed from 
a world wide port network and a world wide airport network. 
The simulations present the fraction of nodes remaining in 
the largest cluster of the airport network, Poo, after a frac- 
tion p of the ports in the port network are randomly removed 
(similar results are obtained for the opposite case). The re- 
sults are compared between two different configurations, (i) 
(Squares) The networks are randomly coupled, (ii) (Circles) 
The networks are coupled according to geographic locations 
(GL), i.e., an airport depends on the nearest port and vice 
versa. When the networks are coupled by GL the system is 
significantly more robust to random failure (the value of p for 
which Poo approaches zero is much smaller). 



Until now we have shown the critical effect of inter- 
similarity on the robustness of a system composed from 
interdependent networks. But what is the effect of the 
local properties within each of the networks on the ro- 
bustness of the interdependent system? Here we show 
that the degree-degree correlation (DDC) @ within a 
network that has only a minor effect on the robustness of 
single networks, greatly effects the robustness of an in- 
terdependent system. While for single networks a higher 
DDC usually slightly increases the robustness of the net- 
work for an interdependent system a higher DDC signifi- 
cantly increases the vulnerability of the system. In Fig [3] 
we demonstrate the effect for the case of ER networks. 
For ER networks that are characterized by a very nar- 
row degree distribution, the DDC is expected to have a 
very limited effect on a single network. But, when two 
such ER networks with high DDC become randomly in- 
terdependent the effect of the DDC becomes dramatic, 
as shown in Fig [31 

After showing that real coupled networks are indeed 
inter-similar, we present a mechanism for generating 
inter-similar coupled networks. The model we present 
can be regarded as a generalization of the Barabasi- 
Albert (BA) preferential attachment model [l5|, [l6| to 
two interdependent networks, that naturally incorporates 
inter degree-degree correlations between the nodes of the 
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correlation but without inter-clustering coefficient. Our 
simulations also confirm that an interdependent system 
generated according to the generalized BA model is sig- 
nificantly more robust to random failure than a randomly 
interdependent system. 

We thanks the European EPIWORK project, the Is- 
rael Science Foundation, the ONR and the DTRA for 
financial support. 



FIG. 3: Simulation results for ER networks with (k) = 3.75 
showing the effect of changing the degree-degree correlation 
(DDC) within a single network (solid symbols) compared to 
the effect in two interdependent networks (open symbols). For 
the case of interdependent networks the DDC is measured 
within each network and the IDDC and ICC are kept zero. 
Even though the effect of the DDC on a single network is 
minor (solid circles) it significantly decreases the robustness 
of interdependent networks (open circles). 



two networks. According to the BA model, a single net- 
work with an initial set of uiq randomly connected nodes 
is grown by adding on each step a new node that is con- 
nected to m different nodes from the already existing 
network. The probability of the new node to connect 
to a specific node is proportional to that node's degree. 
Generalizing the model to two interdependent networks 
A and B, we start with two initial sets of nodes m A and 
m B of the same size. The two sets are each internally 
randomly connected and in addition each node from m A 
is randomly connected to one node in m B . On each step 
i, a pair of dependent nodes {A t ,B t } are added to the 
networks, A t to network A and B t to network B, indepen- 
dently, according to the preferential attachment model. 
Since the two nodes are added independently, there is no 
correlation between the neighbors of node A t in network 
A and the neighbors of B t in network B. This process 
mimics a natural process of two interdependent growing 
network. In terms of our initial example of a power net- 
work and a communication network, at different times 
new developing areas are populated and connected to in- 
frastructures. Every such area adds a pair of dependent 
nodes, a power node and a communication node. Even 
though A t and B t are differently connected within each 
network, because of the preferential attachment process 
the fact that they were added at the same time signifi- 
cantly increases the probability that they have a similar 
degree. When simulating a system of two interdependent 
networks according to our generalized BA model we ob- 
tained two SF networks with A = 3 as obtained by the 
BA model for a sing le SF network [H[lfJ. We also ob- 
tain a very high level of IDDC (r AB — 0.6) without any 
change in the ICC value (c AB =0). Our model therefore 
provides a natural mechanism for generating SF inter- 
similar coupled networks with high inter degree-degree 



[1] http://empcommission.org/docs/A2473-EMP_Commission-7MB.pdf 
[2] V. Rosato, L. Issacharoff, F. Tiriticco, S. Meloni, S. De 
Porcellinis and R Setola, Int. J. Critical Infrastructures 

4, 63-79 (2008). 
[3] S. Rinaldi, J. Peerenboom and T. Kelly, IEEE Control 

Systems Magazine 21, 11-25 (2001). 
[4] J. Laprie, K. Kanoun and M. Kaniche, Lecture Notes in 

Computer Science 54, 4680 (2007). 
[5] M. Kurant and P. Thiran, Phys. Rev. Lett. 96, 138701 

(2006). 

[6] S. Panzieri and R. Setola, International Journal of Mod- 
elling, Identification and Control 3, 69 (2008). 
[7] S-V. Buldyrev, R. Parshani, G. Paul, H-E. Stanley and 

5. Havlin, Nature 464, 1025-1028 (2010). 
[8] R. Parshani, S-V. Buldyrev and S. Havlin, Phys. Rev. 

Lett. 105, 048701 (2010). 
[9] M-E-J. Newman, Phys. Rev. Lett. 89, 208701 (2002). 
[10] S-N. Soffer and A. Vzquez, Phys. Rev. E 71, 057101 
(2005). 

[11] According to the assumption made in [3, __] that a node 
from A depends on at most one node from B, kf is the 
maximum number of neighbors of Aj that can depend 
on neighbors of Bj. However, for a more general model 
where a node can depend on more than one node kf must 
be replaced by the new maximum. 

[12] P. Erdos , A. Renyi, I. Publ. Math. 6, 290-297 (1959). 

[13] P. Erdos, A. Renyi , Inst. Hung. Acad. Sci. 5, 17-61 
(1960). 

[14] Bollobas B (1985) Random Graphs (Academic Press, Or- 
lando) . 

[15] A-L. Barabasi and R. Albert, Science 286, 509-512 
(1999). 

[16] A-L. Barabasi and R. Albert, Rev. Mod. Phys. 74, 47-97 
(2002). 

[17] R. Capello, Indivisibilities, synergy and proximity: 
the need for an integrated approach to agglomeration 
economies 100, 145159 (2009). 

[18] K. Button, P. Nijkamp and H. Priemus, Transport Net- 
works in Europe: Concepts, Analysis and policies 35-56 
(1998). 

[19] M. Fujita and T. Mori Journal of Development Eco- 
nomics 49, 93120 (1996). 

[20] C. Rozenblat, Urban Studies (2010). 

[21] R. Albert, H. Jeong and A-L. Barabasi, Nature 406, 378- 
482 (2000). 

[22] R. Cohen, K. Erez and D. Ben-Avraham and S. Havlin, 

Phys. Rev. Lett. 85, 4626 (2000). 
[23] D-S. Callaway, M-E-J. Newman, S-H. Strogatz and D-J. 

Watts, Phys. Rev. Lett. 85, 5468-5471 (2000). 



